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[57] ABSTRACT 

A system using an input integrated flat panel display of 
an integrated structure, having an input device for in- 
putting through handwriting characters, graphics, or 
points and a flat panel display laid upon the input device 
for displaying in accordance with an input point data 
input through handwriting. The frame memory of a 
large screen having a display screen larger than that of 
the flat panel display is arranged to be read out through 
the input device of the input integrated flat panel dis- 
play. In addition, the readout contents of the large 
screen frame memory is arranged to be copied onto the 
flat display of the input integrated flat panel display. 
The input integrated flat panel display system can im- 
prove the man-machine performance while the amateur 
end user performs document processings, graphic pro- 
cessings and the like. 

12 Claims, 24 Drawing Figures 
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CHARACTER RECOGNITION AND DISPLAY 
INPUT INTEGRATED FLAT PANEL DISPLAY DEVICE"; and (5) Japanese Patent Laid-Open Publica- 
SYSTEM tion No. SHO 58-144287 entiUed "HANDWRITING 

„ _ INPUT WORD PROCESSOR" wherein there is de- 

CROSS-REra^NCK TO RELATED 5 scribed a flat panel display having a transparent digi- 

ArFUCATlONS tiier mounted on the upper face of a flat display (such as 

This application relates to two U.S. applications Ser. an LCD (Liquid Crystal Display), EL (Electro- 
Nos. 716,943 and 716,944, filed Mar. 28, 1985 and as- Luminescent) or plasma display), the input device and 
signed to the present assignee, one being entitled the output (display) device being integrated. 
"Method for Designating a Recognition Mode in Hand- 10 The input/output integrated display uses as a display 
written Character/Graphic Recognizer", based on Jap- device a flat panel display unit such as a LCD. This is 
ahese Patent Application No. 59-58298 filed Mar. 28, because the flat panel display unit is suitable for attain- 
1984 and the other entitled "Apparatus for Recognizing ing an integrated structure. The following problems 
and Displaying Hand-written Characters and Figures" arise if a highly precise and fine display type CRT dis- 
eased on Japanese Patent Application No. 59-60717 15 play is used as a display device for the input/output 
filed Mar. 30, 1984, and whose disclosure is incorpo- integrated display: 

rated herein by reference; (i) The thickness of the glass on the CRT screen is 

BACKGROUND OF THE INVENTION about 2 cm » wnicn results in a relatively long distance 

n ^ , J ~ n between the writing surface of the input plate and the 

The present invention relates to an input integrated 20 display surface. Therefore, parallax exists and a special 
flat panel display system with a good man-machine coordinate transformation is required for compensating 
performance in which an input device and an output tne parallax wu^taaim^ 
device are integrated and the user can input data in n\ c: nr#k j ictan „^ u^ iaan t u<* _r 
handwritten form which is Stable for unskilled or J? LZ ? the wntmg surface 
amateur end users not accustomed to keyboards. 25 S^^l^St^T h USe L° btainS a 

Recently, rapid development has occurred in the JJ^^^J^^^ "T* T 
business transaction field Linly with respect to such -S^^SS^ 0 " ? ?" "* be 

operations as a document processing and graphic or recognized which might be subjected to 

figure processing, office automation has progressed Ch ™ g * !° r c ? wn £ e b u y thc ° f °P«ator. A 

rapidly, and OA (Office Automation) apparatuses such 30 ™™™ to solve the above problems has been proposed 
as word processors and personal computers have been by Jomt mvcntors of ^ present application in Japanese 
increasingly employed. Conventionally, in processing Patent L^-Op™ Publication No. SHO 59-183428 laid 
data handwritten characters of figures are inputted opcn ° ct 18 ' 1984 and entitled "METHOD OF IN- 
through an input device such as a digitizer called a PUT-OUTPUT COORDINATE TRANSFORMA- 
"tablef and the recognized results or handwritings are 35 TION FOR INPUT INTEGRATED DISPLAY DE- 
displayed on an input device, such as a CRT (Cathode V 1CE M but this reference is not prior art. 
Ray Tube) display and then subjected to various pro- A dis Pky device such as an LCD for use with an 
cessings. With the system using such input and output input/ output integrated flat panel display, however, has 
devices independent from each other, the user must two technical problems as compared with a CRT dis- 
confinn the inputs of characters or figures written on 40 P Iav: 0) there are sonie restrictions on the display area, 
the digitizer by looking on each input occasion at thc and 50 il & difficult to obtain a highly precise and fine 
CRT display. Abo, in editing, it is necessary to observe display type device and also it is difficult to obtain a 
the characters or figures written on the CRT display ^ale screen as the user desires; (2) it is not suitable 

while operating upon the digitizer. Thus, the work *° r a multi-color display and is not applicable in sophis- 
efficiency of the conventional device is very low. 45 Seated application fields, such as CAD/CAE (Com- 

Also known is a system using a CRT as an output P utcr Aided Design/Computer Aided Engineering), 
device and a light pen as an input device. This system, Therefore, it is common to use, instead of the input 
however, has serious problems, since the thickness be- integrated flat panel display alone, both the input inte- 
tween the surface of a CRT and its fluorescent screen is grated flat panel display and the highly precise and fine 
more than 10 mm, and so the problem of parallax is 50 display type CRT for carrying out a subtle processing 
difficult to solve; in addition, the user's arms become of handwritten characters or graphics. The reason for 
fatigued to a large degree unless the environmental this is that the above problems can be solved at once by 
structures are modified. displaying a whole screen of data onto a highly precise 

Apparatuses solving the above problems and iraprov- and fine display type CRT display and by performing an 
ing operational performances are known in: (1) an arti- 55 input/output (display) operation, carried out for part of 
clc entitled "ON-LINE HANDWRITTEN CHINESE the whole screen (or for a partial screen), through an 
CHARACTER RECOGNITION HAVING A input integrated flat panel display. 
TREND OF RELAXING RESTRICTIONS ON With the system arrangement as mentioned above, a 
THE WAY OF HANDWRITING SUCH AS DE- scrolling function for the input integrated flat panel 
FORMED WRITING CHARACTERS" at pages 1 15 60 display is indispensable in view of the display area and 
to 133, Vol. 12.5, 1983, of NIKKEI ELECTRONICS display resolution of the flat panel display. In addition, 
published by Nikkei-McGraw-Hill, Inc.; (2) Japanese the rnan-machine performance is further improved if 
Patent Laid-Open Publication No. SHO 49-123239 enti- the apparatus is provided with a zooming function 
tied "PICTURE IMAGE INPUT DEVICE"; (3) Japa- which changes the correspondence ratio between the 
nese Patent Laid-Open Publication No. SHO 58-14247 65 display screens of the CRT display and the input inte- 
entitled "COORDINATE INPUT DEVICE WITH grated flat panel display. However, an input integrated 
DISPLAY"; (4) Japanese Patent Laid-Open Publica- flat panel display provided with scrolling and zoominc 
tion No. SHO 58-96382 entitled "HANDWRITTEN functions has not yet been realized. 
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Conventional scrolling functions provided for a sin- dinate information; and display control means for pick- 

gle display device other than an input integrated flat ing up part of the input coordinate information from the 

panel display are not convenient in use. That is, in gen- coordinate information of the large screen and for con- 

eral, instructions for scrolling are made by the operator verting the part of the input coordinate information into 

by selecting and manipulating one of a plural buttons in 5 the coordinate information of the flat panel display; 

accordance with the direction of scrolling the operator wherein the transformation control means and the dis- 

desires; the manipulation must be continued for the time play control means are controlled by a bias value or 

proportional to the distance to be scrolled; and in order start address. 

to set a desired direction for scrolling, a suitable combi- Therefore, the contents of the frame memory of the 
nation of those buttons must be properly chosen. Fur- 10 ^ scree n, which is larger than the display screen of 
thermore, another system is known in which the coordi- the flat panel display, can be read out by the user from 
nate input area and the scrolling instruction area are ^ mpilt dcvice of ^ x intcgrated flat panel dis- 
used incommon and a mode change-over * necessi- play . ^ additioil| the read -out contents of the large 
toted. That is^n a scrolling instruction mode in such a frame m ^ ied Qn the flfll * 
system, a desired point is pointed to rn order to display 15 dis j of ^ m t micsnitcd fl £ cl display . As a 
the corresponding area. Such system essentially re- ^ the Machine performance is gready im- 
quires a mode changeover so that the operations are prove4 while allowmg J amatcur efld J cv iQ y carfy 

Tur^STapart from the problems described above, if ° Vtaifl^^ graphicS ^ ^ ^ , 

the input inte^ated flat panel display can be used as one 20 , *£Z ™T^ f ^ xclusivc ^ sc w . Ith th /^ at P^ neI 

of the peripheral devices of a multipurpose personal ShJE* F7 f " 1°™*™*™ °! d,ffcr " 

computer aid the like, it is possible to process handwrit- $ nc ? ^tween display refresh cycles of the large screen 

ten characters or figures with ease and low cost by dlSplay and flat diS ^ 

simply connecting the flat panel display to the conven- BRIEF DESCRIPTION OF THE DRAWINGS 

tional apparatus main frame. Thus, vast applications to 25 - . . . 

not only professional users but also amateur end users f FIGt 1 "* diagram showing an overall construction 

are possible. In the case where the input integrated flat ? f m f ut lntegra f ed flat P anel s y stem accord " 

panel display is used as a peripheral device, since a m * th * ? resent mventlon i 

typical personal computer or the like is provided as a . FlG / 2 B a transvcrse sectional view of the 

display interface only with an interface (video signal 30 m P?* mt egrated flat panel display; 

line) for use in displaying on a CRT display, some modi- . FIG ' 3 B a transverse cross sectional view showing 

fications of the hardware of the personal computer main the P ortion of toe m P^ mtegrated flat panel display 

■frame become necessary. where the LCD P^ 1 ^ tne like «re not included; 

The present invention has been made in view of the FIG ' 4 is a latcral cross sectional view of the input 

above-mentioned prior art problems, particularly in 35 integrated flat panel display; 

view of the fact that the flat panel display serving as a 5 ls a diagram showing an overall construction 

display screen of an input integrated flat panel display °f tne system according to a first embodiment of the 

has an insufficient display area and display resolution. present invention; 

FIG. 6 is an outer appearance of the input surface of 

SUMMARY OF THE INVENTION ^ the input integrated flat panel display unit according to 

*It is an object of the present invention to provide an a 8*** embodiment of the present invention; 

input integrated flat panel display system in which part FIG, 7 is a flow chart for explaining the operations of 

of a large screen (CRT display screen) larger than the toe control unit of the input integrated flat panel display 

display screen of an input integrated flat panel display system according to the first embodiment; 

can be displayed freely on the input integrated flat panel 45 FIG* 8 is a block diagram of the frame memory and 

display and in which the coincidence between the coor- LCD controller in the first embodiment; 

dinates of the input and output (display) can be attained. FIG. 9 is a flow chart for explaining the operations of 

It is another object of the present invention to pro- the LCD controller in the first embodiment; 

vide an input integrated flat panel display system which FIG. 10 is a similar flow chart for explaining the 

is provided with a scrolling function and a zooming 50 operation of the LCD controller in the first embodi- 

function. ment; 

It is another object of the present invention to pro- FIG. 11 shows an overall arrangement of a second 

vide an input integrated flat panel display system which embodiment according to the present invention; 

can display part of a large screen (CRT display screen) FIG. 12 is a view showing points obtained while 

using a video signal line for the CRT display. 55 drawing strokes on the scroll appointment section of the 

In an input integrated flat panel display having, in an input integrated flat panel display unit in the second 

integrated form, an input device for inputting, through embodiment; 

handwriting, characters, graphics, figures or points, and FIG. 13 is a flow chart for explaining the processings 

a flat panel display for displaying the input handwrit- of the processing device in the second embodiment; 

ings corresponding to the input coordinate information, 60 FIG. 14 is a block diagram of the frame memory and 

the present invention aims at improving the man- LCD controller in the second embodiment; 

machine performance by incorporating the following FIG. 15 shows an outer appearance of a general sys- 

four means. In particular, there are provided a large tern arrangement employed in writing hand-written 

screen frame memory for storing coordinate informa- characters and graphics using a personal computer, in 

tion of a large screen (CRT screen) larger than the flat 65 association with a third embodiment of the present in- 

panel display; a register for storing a start address; con- vention; 

trol means for controlling the transformation of the FIG. 16 shows an outer appearance of the whole 

input coordinate information into the large screen coor- arrangement of the third embodiment; 
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FIG. 17 shows an overall arrangement of the third The CPU 4 includes a frame memory for virtual large 
embodiment; screen (not shown and also called a video memory) for 

FIG. 18 is a flow chart for explaining the operation of storing information as to data to be displayed on the 
the control unit in the third embodiment; CRT display screen, which is a large screen. The input 

FIGS. 19(a) and »(*) are views respectively show- 5 coordinate transformed into the CRT coordinate at the 
tag points obtained while drawing strokes on the scroll digitizer/CRT coordinate transformation unit 6 is writ- 
appointment section of the input integrated flat panel ten into the virtual large-screen frame memory. The 
display according to the third «abodiment; display information written in the frame memory is 

FIG. 20 is a block diagram of the LCD controller m transferred respectively to the CRT/LCD transforma- 

JS^'Z^EFi* • u 10 tion unit 8 and CRT display 9. The display information 

FIG. 21 is a block diagram of toe circuit for the is displayed on the LCD 2 after it is transformed into the 
judgement in the LCD controller and for the anthmebc output coordinate for the LCD at the CRT/LCD trans- 
and log* operation of the wnte-m address of the LCD fonnation ^ 8 to ^ ^ cornerd . 
ft^m^ory according to the tmrd embodunent; ence between an input poL and Z output dismay 

• ^^l??^ 8 ?' 15 ^ while the oisplay information transfeVred to the 

m^fi P ? llerofthetlurd emb^nnent;and CRT display 9 is directly displayed. 

FIG. 23 is an outer appearance of the input integrated T _ _ Jj'i-, . a: „ .„ . • ,, 

flat panel display unit according to a modffication of the a Jl^^'^ 0 P T mvmaon ' *" 

present invention. accesses to the virtual large-screen frame memory are 

„ performed in the coordinate system for the large screen 
DESCRIPTION OF THE PREFERRED (e g- CRT screen). After retaining the display on the 

EMBODIMENTS CRT display 9, the write-in and read-out for the frame 

The embodiments of the present invention will now me ^ ry „ * *e input inte- 

be described with reference to the accompanying draw- !l at Z 5 havm 8 a smaller display 

ingj, 2J screen. Furthermore, in practicing the present inven- 

tion, various embodiments are presented such as in the 
(1) Outline of Overall Arrangement of the Invention case of independent use of the input integrated flat panel 

In FIG, 1, numeral 1 represents a stylus pen for input- or m 0886 of usin « thc ^put integrated flat 

ting a coordinate, numeral 2 represents a liquid crystal panel dss ^ B Y 38 a peripheral device of the personal 
display or LCD, and numeral 3 represents an electro- 30 com P uter or toe lu «. 

magnetic digitizer, these element* as a whole fonning (2) Structure of Input Integrated Flat Panel Display 
an input integrated flat panel display 5. The particular y y 

structure of the input integrated flat panel display 5 will , Next ' ^ e structure of the input integrated flat panel 
be described later and is of an integrated structure in display will be described. The input integrated flat 
that the liquid crystal 2 as a display device and the 35 P^ 1 dis P la Y nas an integrated structure in that the 
electromagnetic digitizer 3 placed beneath the former upper LCD and the lower electromagnetic coupling 
are laid one upon the other. Since the liquid crystal *yP e digitizer are piled up one upon the other. The 
display 2 can be manufactured thinner than 5 mm, the reason why the electromagnetic digitizer is placed be- 
electromagnetic wave generated from the coordinate neath the LCD is that the LCD can be manufactured 
pen 1 in the form of a pulse magnetic field can be de- 40 thinner than the electromagnetic digitizer. Thus, it is 
tected with the electromagnetic digitizer 3 even in the advantageous in that parallax is maintained at a mini- 
intermediate presence of the liquid crystal display 2 to a mum 35 compared with the case in which the digitizer is 
sufficient extent that the coordinate pointed out with made transparent and is placed upon the display face 
the pen 1 can be read. (LCD). In addition, it is advantageous in that the dis- 

The area of the LCD 2 serving as a display section of 45 P*ay is not hindered by the existence of connection 
the input integrated flat panel display 5 is smaller than wires for use in detecting the input coordinate and that 
that of a CRT display 9 having a large screen. There- the material of the digitizer surface (for a pressure-sensi- 
fore, a scrolling function to move the displayed data on tive digitizer) is not restricted. The structure described 
the display 5 is required herein is disclosed in Japanese Patent Laid-Open Publi- 

The input coordinate of the electromagnetic digitizer 50 cation No. SHO 58-96339 entitled "COORDINATE 
3 of the input integrated flat panel display 5 pointed out READ-OUT AND DISPLAY DEVICE" and Japa- 
with the coordinate input pen 1 is transferred to a digiti- nese Patent Laid-Open Publication No. SHO 58-96337 
zer/CRT coordinate transformation unit 6 for trans- entitled "COORDINATE READ-OUT AND DIS- 
forming an input coordinate into a large screen frame PLAY DEVICE". 

memory coordinate and to a start address control unit 7. 55 The electromagnetic coupling type digitizer referred 
The digitizer input coordinate transferred to the digiti- to herein is a system in which the coordinate input pen 
zer/CRT coordinate transformation unit 6 is trans- is excited and the resultant pulse magnetic field is de- 
formed into the CRT display screen coordinate and tected by a conductive wire group embedded in the 
transferred to a processing unit main frame 4 (hereinaf- digitizer. For example, DT-4010 electromagnetic cou- 
ter referred to as CPU), The digitizer input coordinate 60 pling type digitizers manufactured by SEIKO ELEC- 
is also transferred to the start address control unit 7 TRONICS COMPANY may be used. The detail of the 
which transfers a start address (scroll appointment in- principle is described in the Japanese article entitled 
formation) indicative of the start point on the screen to "PRINCIPLE AND APPLICATIONS OF DIGI- 
the digitizer/CRT coordinate transformation unit 6 and TI2ER" in 'TRANSISTOR TECHNIQUES" pub- 
also to CRT/LCD coordinate transformation unit 8 65 lished by CQ PUBLICATION company in May, 1983. 
forming part of the display control for transforming a By using such digitizers, it is possible to read the coordi- 
large screen frame memory coordinate into a flat panel nate even if the pen is spaced 5 to 7 mm from the surface 
display coordinate. of the digitizer. 
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FIG. 2 shows a transverse cross sectional view of the tal common (row) drivers 20 for driving in the Y-direc- 
input integrated flat panel display 5 comprised of the tion and eight liquid crystal column drivers 21 for driv- 
liquid crystal display 2 and the electromagnetic cou- ing in the X-direction are respectively used so as to 
pling type digitizer 3. The digitizer 3 includes a detec- display and control each block. Clock signals 11' are 
tion coil printed circuit board 13 and an input coordi- 5 delivered to the common (row) drivers 20 and column 
nate detection control circuit 15 (digitizer controller). drivers 21, while liquid crystal display signals 111 are 
On the digitizer 3, the LCD 2 is placed, which com- independently delivered to respective ones of eight 
prises a liquid crystal driver 14 (although described liquid crystal column drivers 21. Numeral 35 represents 
later, this includes liquid crystal common drivers 20 a power source for the LCD, which is supplied to the 
corresponding to CRT row drivers and liquid crystal 10 common (row) drivers 20 and column drivers 21, re- 
column drivers 21), liquid crystal element 19, polariza- spectively. 

tion plates 10 and 18, reflection plate 11, liquid crystal The connection between the liquid crystal panel 12 

panel 12 and the like. Numeral 1<5 represents a flexible and the liquid crystal driver 14 is effected using the 

printed wiring board. A twisted-nematic device is used flexible printed wiring board 16 so that the liquid crystal 

as a liquid crystal element and a reflection type liquid 15 driver can be mounted beside the liquid crystal panel 12. 

crystal display device is formed by incorporating the . 

reflection plate 11. By the provision of a transparent ( 3 ) Fir8t Embodiment of the Invention 
surface protective plate 17 for protecting the surface of The first embodiment of the invention will be de- 
the upper polarization plate 18, scratches on the polar- scribed with reference to FIG. 5. In the figure, elements 
ization plate 18 which might be caused by repetitive 20 designated by the identical numerals to those in FIG. 1 
input accesses with the coordinate input pen 1, can be operate to perform the same functions, 
avoided. With the structure as described above, the The first embodiment uses an input integrated flat 
distance between the surface which the tip of the coor- panel display and a CRT display in combination. The 
dinate input pen 1 contacts and the display surface 19 frame memory for the CRT display is separately pro- 
(liquid crystal element) can be made small so that the 25 vided so as to provide a display on the CRT display. In 
influence of parallax is suppressed to the minimum. this case, as seen from the above description, by point- 
Numeral 101 represents a signal line for transferring the ing with the pen to the coordinate on the liquid crystal 
input coordinate from the digitizer controller 15, and display of the input device of the input integrated flat 
numeral 111 (1110 represents a signal line connected to panel display, it is possible to identify the display screen 
the liquid crystal driver 14 so as to drive the liquid 30 coordinate on the CRT display of a large screen. Scroll- 
crystal element 19. ing and zooming functions are also referred to hereinaf- 

A comparison of the present system with the nor- ter. 

mally used liquid crystal module is here given, Most of Referring to FIG. 5, the overall flow of the system 

the conventional common liquid crystal modules are operation will be described in brief. The electromag- 

constructed in such a way that the liquid crystal driver 35 netic digitizer 3 detects a coordinate pointed out by the 

is positioned beneath the liquid crystal panel. However, coordinate input pen 1, and the detected two-dimen- 

in order to detect the magnetic field generated from the sional coordinate (X, Y) is transferred to the coordinate 

coordinate input pen 1 with the detection coil printed transformation control unit 6 of the input integrated flat 

; board 13 of the electromagnetic coupling type digitizer, panel display via the signal line 101. Although the liquid 

the distance between the magnetic field generating and 40 crystal display 2 is positioned intermediate the coordi- 

detecting positions must be shorter than 5 mm. Further, nate input pen 1 and the digitizer 3, since the thickness 

if there exists a liquid crystal driver 14 and the like is smaller than 5 mm, the electromagnetic wave radi- 

intermediate of the two positions, noises are produced. ated from the pen 1 can reach the digitizer 3 and the 

As a solution to the above, as shown in FIG. 2, the pointed-out coordinate can be read out In the present 

liquid crystal driver 14 is positioned at the sides of the 45 embodiment, the liquid crystal display is composed of 

liquid crystal panel 12 by using the flexible printed 640x256 pixels. 

wiring board 16. By doing so, the distance from the The coordinate (X, Y) input to the digitizer 3 and 

surface protective plate 17 to the reflection plate 11 transferred to the coordinate transformation unit 6 of 

should be shorter than 5 mm to makes it possible to the input integrated flat panel display is transformed 

effectively detect a pulse magnetic field. 50 from the digitizer coordinate system into the CRT coor- 

A transverse cross sectional view of the portion dinate system. The transformed coordinate is trans- 
where the liquid crystal panel 12 and the like are not ferred as scrolling or zooming display control signals to 
present is shown in FIG. 3. Also at the portion includ- the liquid crystal controller 8 via a signal line 102, and 
ing the liquid crystal panel 12 and the like shown in the two-dimensional coordinate (x, y) transformed to 
FIG. 2, the digitizer 3 for inputting the coordinate is 55 the CRT coordinate system is transferred to the pro- 
positioned in juxtaposition to the surface of the flat cessing unit main frame 4 (CPU) via a signal line 103. 
panel display 5 in order to make handwriting input easy. The detailed description of the operations of this circuit 

FIG. 4 shows a lateral cross sectional view of the portion will be described later with reference to FIG. 6. 

input integrated flat panel display 5. Aside from the The processing method for the coordinate (x, y), to 

liquid crystal panel 12, the liquid crystal driver 14, i.e., 60 be carried out at the CPU 4, varies with the mode at a 

liquid crystal common (row) drivers 20 and liquid crys- given time. Since the processing method is the same as 

tal column drivers 21, are mounted and connected for the combination of a conventional digitizer and a 

through the flexible printed wiring board 16. The liquid CRT display, the most simple case will be described 

crystal panel 12 drives its liquid crystal elements here in which the input coordinate (x, y) is displayed by 

through a multiplexing drive. If a frame frequency is set 65 means of echo-back. 

about 70 Hz, the liquid crystal panel 12 must be divided Upon reception of the coordinate (x, y), the CPU 4 

into eight blocks due to a low response speed of the delivers to frame memories 22 and 23 a write-in address 

liquid crystal elements. For this reason, two liquid crys- via address lines 104 and write-in data via data signal 
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lines 105. The frame memory 22 is a large screen mem- 
ory providing one bit for one pixel for storing a pattern 

output to the liquid crystal display. The frame memory x o - 1280 • tf max 1 Y m 

23 is a memory for storing a pattern output to the CRT 
and stores a number of bits for each pixel, correspond- 5 r = 1024 ■ y ~ r "»" ( 2 > 
ing to the number of colors feasible for the output The o = ■ Ymax _ y m[n 

CRT display 9 used in the present embodiment is as- 
sumed to display 1280x1024 pixels so that the frame Through the coordinate transformation, the values of 
memories each have a memory capacity of 1280x1024 &°* respectively normalized within 
pixels. 10 0^X^1280 and 05 Y* 1024. The numbers 1280 and 
A CRT display circuit 24 (CRTC) reads out the con- * 024 OT ™»pond to the number of dots of the CRT 
tents of the frame memory 23 in synchronization with ^P 1 ^ ^ ^oordmate (Xa Yq) indicates the upper left 
the refresh cycle of the CRT 9. To this end, the CRTC on hquid crvstal dis P lav - In the 

24 outputs an address of the frame memory 23 onto a 15 ^ShV^^^T^^ 'v ' 
signal line 107 and receives the readout data from a 15 £2^W ^? Y °V? d <*T 255 ' Y °r 639) lS 
signal line 1^ 

9 as a video signal 108 The CRT display circuit 24 may controller 8 via the signal line 102. 

be^a known type such as ^1 type CRT controller Alternatively, if the digitizer coordinate (X, Y) is on 

HD6845 manufactured by HITACHI LTD.). 20 the J zooming display section 26, that is, the coordinate 

The liquid crystal controller 8 reads out necessary (X, Y) is within the range from X mim Y min ) to <X max , 

data from the frame memory 22 for the liquid crystal Y^), is then the display mode at that time is changed: 

display and coordinate-transforms from the CRT coor- (1) in the case of the normal display mode, the mode 

dinate to the liquid crystal coordinate so as to provide a is changed to the i zooming display mode; and 

display on the liquid crystal display 2. In particular, the 2 * (2) in the case of the i zooming display mode, then 

liquid crystal controller 8 outputs an address of the the mode is changed to the normal display mode, 

frame memory 22 onto a signal line 110, and receives The coordinates (Xa Yo) and the display mode are 

the read-out data from a signal line 109 to thereby de- stored in the control unit 6 of the input integrated flat 

liver the read-out data to the liquid crystal 2 via the dis P la y and also transferred to the transformation 

signal line 111 (111 ) (the signal line 111 (1110 used for 30 controller 8. 

driving the liquid crystal driver 14 as shown in FIGS. 2 If ±c digitizer coordinate (X, Y) corresponds to the 

and 4). The liquid crystal display 2 receiving the data ***** of the {i< ^ d crystal dis P la Y section 2, that is, in the 

displays the contents of the frame memory so that the ^5T e toecoordinate (X, Y) is within the range 

operator can observe the displayed information at the « : ro ™ &? min > ymin) to (XX OTffl6 YY m ax), then in order 

position corresponding to that mput with the coord' 35 ? tra « sf °™ mput digmzer coordinate (X, Y) into 

nate incut oen 1 the coordmate (*• v ) of th « frame memory 22, the fol- 

xr * i A * . , lowing calculation is executed, 

Next, an exemplary outer appearance of an input face 

of the input integrated flat panel display is shown in 

FIG. 6. The digitizer 3 has a larger dimension than the 40 (x \ (a o * N fx \ fx Q \ (3) 

liquid crystal display section, since the upper portion of " M \ \\ Y + 

digitizer 3 has a coordinate appointment area for scroll- V / \° c 4 ) \ 1 / V° / 
ing and a display screen control section for i zooming 

reduction) display and the lower portion of has the where a, b, c, and d represent predetermined constants 

coordinate appointment section for the liquid crystal 45 for use in transforming the digitizer coordinate system 

display 2. In FIG. 6, numeral 2 represents the liquid into the liquid crystal display system, (Xo, X<j) repre- 

crystal display section, numeral 25 represents the scroll- sents the coordinate given on the scroll appointment 

ing appointment area, and numeral 26 represents the i **ea, and M represents a constant which is 1 for the 

zooming display section. The scroll appointment area normal display and 2 for the i zooming display. The 

25 and J zooming display section 26 are provided for 50 obtained coordinate (x, y) corresponds to the coordi- 
improving the man-machine performance of the input on the CRT screen. 

integrated flat panel display in consideration of the fact $ shows a detailed block diagram of the frame 

that the display area of the input integrated flat panel memory 22 and the transformation controller 8. The 

display is smaller than that of the CRT. frame meinor > r 22 comprises a memory address control 

Next, referring to the flow chart of FIG. 7, the con- 55 ™£™ t A 28 J° r controlling memory accessings from the 

trol unit 6 of the input integrated flat panel display will CFU 4 and J*^ 0 ™** 0 " controller 8 in time division, 

be described. The digitizer coordinate (X, Y) input a . mffl f^ f 27 ' $r «* tta ?%L and logic operation 

through the signal line 101 is checked o determL T!11ft g fc ™n 

whether it is within the scroll appointment area 25 or « fh ^Z^ ^ * ? PU 4 W ? h 

not. Uus means to check whether** value of (X, Y) is 60 ^tr?t e ^ 

within the value from (X m ,„, Y mtn ) to (X maXl yJJ.tL Z^S^l^S^^ " ^ 

^S^F" ?otT 6 " ^ ^ ^ 105 is «-^o?T5^ bit arrangement 

Z Jv 6 ? 9 ' ... 65 other hand & e frame memor V 2 2 is composed of one bit 

It the coordinate (X, Y) is within the scroll appoint- arrangement since the liquid crystal display is used, 

ing area 26, the coordinate transformation is performed Therefore, at the arithmetic operation circuit 29, the 

in accordance with the following equations, plural bit arrangement is changed into a one bit arrangc- 



01/05/2004, EAST Version: 1.4.1 



4,730,186 

11 12 

ment. Although various constructions can be thought of After transfer of the 20 bit pixels, in order to obtain 

for the arithmetic and logic operation circuit 29, in the following 20 bit address in the X-direction, the rcg- 

order not to lose any information. In the present em- ister WK4 is set with the value WKO-f WK2 so as to 

bodiment a logical sum is first obtained and then output- enable the setting of the value X + 20. 

ted onto a signal line 112. 5 The newly set address information in the registers 

Out of the data of 1280X 1024 pixels made up on the WK4 and WK5 is used in reading out the data of the 

frame memory 27 by the CPU 4, the transformation eight blocks similarly to the above, and the read-out 

controller 8 controls transfer of the data of 640X 256 data is transferred to the liquid cyrstal display section, 

pixels appointed by the user to the liquid crystal display The operation is repeated eight times, that is, until the 

2 - 10 register WK2 reaches 160, thereby attaining the two 

Registers indicating which portion out of the raster display beginning with (Xq, Yo) and (Xo, 

640x256 pixels to be selected, include a register 32 Yo— 128). 

indicating the start address (Xq, Yo) at the upper left Further, by setting the start address (Xo, Y 0 -l) as 
point on the display, and a register 33 indicating the J (Xo, Yo-1), the next raster is displayed. By repeating 
zooming display mode. The contents of the two regis- 15 these operations 128 times, the whole screen of 
ters may be alterably changed by the control unit 6 of (640x256) pixels are displayed, 
the input integraed flat panel display via the bus 102. In In the case of the J zooming display, every other pixel 
this embodiment, the start address control unit 7 in FIG. in both X- and Y-directions are omitted in the data to be 
1 is built in the control unit 6, from which the start displayed. Therefore, the differences in operation as 
address is written into the register 32. 20 compared to the 1/1 (normal) display are that the pa- 
in order to perform the 640 X 256 pixel display on the rameters for the address operation are set to be twice as 
liquid crystal display section 2, it is necessary to transfer large and that at the parallel to serial conversion circuit 
serial data to the eight blocks for every 160X 128 pixels. 34, data omitting every other pixel among the 20 pixels 
Thus, the accesses to the frame memory 22 must be is outputted onto the bus 111. Thus, the 1280x512 
carried out in conformation to the above requirements. 25 pixels on the frame memory 22 are displayed as the 
In particular, assuming that the lower left point has a 640x256 pixels on the liquid crystal display section, 
coordinate (0, 0), the frame memory 22 is divided into Depending upon the setting of the start address (Xo, 
eight blocks each defined by a pair of apexes of a diago- Yo), if (Xo+639, Yo-255) in the normal display and 
nal, i.e., {(0, 255), (159, 128)}, {(160, 255), (319, 128)}, (Xo+1278, Y 0 -510) in the i reduction display exceed 
i(320, 255), (479, 128)}, {(480, 255), (639, 128)}, {(0, 30 the frame memory coordinates (0, 0) and (1279, 1023), 
127), (159, 0)}, {(160, 17), (319, 0)}, {(320, 127), (479, then 0's are caused to be inputted. 
V)}, and {(480, 127), (639, 0)}. According to the above embodiment, it is possible to 
For this reason, eight parallel to serial conversion display as desired, part of the CRT screen on the input 
circuits 34 for delivering serial data respectively to integrated flat panel display. Furthermore, it is possible 
eight blocks are included in the transformation control- 35 to realize an input integrated flat panel display in which 
ler 8 wherein data output one bit after another from the the input and output coordinates can be made to coin- 
parallel to serial conversion circuit 34 is transferred to cide with each other by indicating with a pen point on 
the liquid crystal display section 2 via the data line 111. the flat panel display screen. 

The operation of the transformation controller 8 will 
be described hereinafter in accordance with the control 40 W Second Embodiment of the Invention 
flow shown in FIGS. 9 and 10. The second embodiment of the present invention will 
First, the start address (Xo, Yo) is set at work registers now be described in connection with FIG. 11. The 
WK0 and WK1 in an address operation circuit 31. Next, present invention is particularly suitable for performing 
the output from the register 33 is checked with a se- scrolling and zooming functions as described in the first 
quence control circuit 30 to determine whether the 45 embodiment The construction of this embodiment in- 
output indicates the J zooming display mode or not. In volves only the input integrated flat panel display and 
the case of the normal display mode, after 0's are set at does not use the CRT display in combination therewith, 
loop check registers WK2, WK3 and WK6, the regis- In the embodiment, elements represented by the identi- 
ters (WKO, WK1) having the values of (Xo, Yo) are set cal numerals perform the same functions as of those in 
as (WK4, WK5); 50 the first embodiment. 

Thus, the frame memory 22 is accessed and the read- A brief description of the embodiment will now be 

out twenty bits are delivered through a bus 109 be set in given in the following. 

the parallel to serial conversion circuit 34-1. In order to provide the scroDing function and zoom- 
Next, the register WK4 indicative of the address in ing function, information indicative of which part of the 
the X direction is renewed by +160 so as to indicate the 55 frame memory storing the large screen is to be pro- 
next block, and similarly to the above the memory is cessed, i.e., a start address (the least number address of 
accessed to set the contents in the parallel to serial con- the frame memory displayed on the flat panel display), 
version circuit 34-2. - ia stored in a register in the CPU 4. If a scroll appoint- 
After repeating the above processings four times, a ment or display is commanded from the input section, 
register WK5 indicative of the Y direction address is 60 the input data is written into the corresponding frame 
renewed by — 128 to thereby perform the memory ac- memory depending on the start addresses stored in the 
cesses corresponding to the lower four blocks and set start address register of CPU 4 by causing the system to 
the read-out data at the parallel to serial conversion rewrite the respective two start addresses. In order to 
circuits 34-5 to 34-8. dispaly data on the display section, it is possible to per- 
After all of the data is read out, then the 20-bit data is 65 form the display by reading out data from the frame 
converted into serial data to output it onto the bus 111. memory in accordance with the start address stored in 
The signal line 111' is for providing the timings of the the display controller. As above, the user can expect 
bus 111 to the liquid crystal display section 2. correct and quick processings while he instructs a 
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scrolling or zooming display in association with the on the scroll appointment section 25 at a high speed, 

large screen and gives a hand-writing input or point then the number of detected points per one stroke be- 

input of an icon. comes small (right side of FIG. 12) and hence the scroll 

Furthermore, it is unnecessary for the user to always of the display becomes quick. Alternatively, if a stroke 
keep in mind in which part of the large screen the pres- 5 is drawn slowly, then the number of detected points 

ently displayed portion located. By virtue of the system becomes large (left side of FIG. 12) and hence the scroll 

in which a display screen can be scrolled in accordance 0 f the display becomes slow. 

with the direction, distance, and speed of a stroke given FIG. 13 shows the processing flow of the input coor- 

on the scroll appointment section for displaying such dinate at the CPU 4. First, the content of the input 
location as desired by the user, it is possible to provide 10 po^n transferred from the digitizer controller 15 of 

the input integrated flat panel display system with a ^ electromagnetic coupling type digitizer is subjected 

hi^noan-machmeperforaiance. _ to a judgement operation 40. If the mput wwrdinate is 

The second embodiment of the present mvention will within ±e area of ^ ^oii appointment section 25, 

now be described with reference to the accompanymg then ^ input coordinate h transferred to a start address 

t^^?^ n ii* * v i , . | 15 control 41, whereby information (start address) indica- 

In FIG U numeral 12 represents a liquid crystal tivc of ^ dis , „ - m transfcrr ^ t0 the tra 4forma- 
p anel as a display section which serves as an input sec- tion the $tart addfess ^ ^ m 

tion for hand-wntten characters or graphics. Numeral *aa~~<> ™ . , , ^ , , . u 

13 represents a detection coil printed I board of an elec- t la f J If 

tromagnetic coupling type digitizer for detecting coor- 20 ^^Kfc^t T ? 
dinatel In the preset mbodLent, there are addition- 5S? y : *** "?? tKmsferred fr0n \ the 

ally provided a scroU appointment section 25 for mov- controller 15 of the electromagnetic coupling 

ing part of the large screen stored in the frame memory typ * » W1 ^ * e area of 

22 and displaying part of the large screen, and a zoom- sectl0n ' ' hei \ at * sta * ° ddress ^ 41 ' the z ™ mm Z 
ing display instruction section 26 for instructing a zoom- 25 ™™*™ d ™ d sta * «W"f « transferred to the trans- 
ing display by which the overall position of the large fora *tion controller 8. In the case where the input 
screen can be recognized at a glance. First, any desired ordinate transferred from the digitizer is within the 
position on the input section is indicated with the coor- of »P* ^™ A"!""* crystal panel 12), the 

dinate input pen 1. Then, the magnetic field passing m P ut coordmate (a. *) is transformed into an output 
through the liquid crystal display panel 12 can be de- 30 coordmate (*. y) at ™ in P ut coordinate/output coordi- 
tected by the detection coil printed board 13 of the •ranrfonnation 102 in accordance with the follow- 

digitizer. The detected signal is converted into an input mg w l uation: 
coordinate through a tablet (digitizer) controller 15 in 

the CPU 4 (which includes the control unit 6 and the , K , s , N (4) 

start address control unit 7), the input coordinate being 35 
processsed in the CPU 4, e.g. f being written in at the 
corresponding point in the frame memory 22. The liq- 
uid crystal controller 8 transforms data in the frame . , 

memory 22 into a liquid crystal display signal. The wnere a md b re P resent predetermmed constants for 
liquid crystal driver 14 receiving the signal displays 40 ^ m transforming the coordinate system of the detec- 
information at the corresponding coordinate position on tion coa P mted board 13 of the electromagnetic cou- 
the liquid crystal panel 12. In the case where the zoom- P lin ? ^ digitizer into the coordinate system of the 
ing display is instructed, the zooming display command ^quid crystal panel 12; and c and d represent variables 
and start address are transferred to the liquid crystal for ^ e start address varying with a scroll appointment 
controller 8 via a zooming and start address signal line 45 at a tunc » tnc variables changing the values every time 
113, and the information in the frame memory 22 is 501,011 811(1 zooming commands are entered. M repre- 
received at the transformation controller 8 to convert it sents a variable indicative of the magnification of zoom- 
into a liquid crystal display signal. Further, a scroll in & the variable changing its value upon the zooming 
appointment signal is transferred to the transformation command and its release. The solved coordinate (x, y) is 
controller 8 via the same zooming and start address 50 delivered to an application 44 and to an echo-back con* 
signal line 113, and the transformation controller 8 cal- trol 43. In the echo-back control 43, a mode assigned at 
culates the memory address of the frame memory and tne time is added to the obtained coordinate (x, y) and 
reads out information corresponding to the calculated an output to a frame memory development 45 is re- 
address 22 from the frame memory 22 to convert it into quested. For example, in the case where a certain dot is 
a liquid crystal display signal and transfer the liquid 55 displayed, at the frame memory development 45, the 
crystal display signal to the liquid crystal driver 14. frame memory 22 is requested to write-in 1 at the por- 
In requesting, a scroll operation, the direction and tion of the frame memory 22 corresponding to the coor- 
distance of the scroll can be instructed by drawing a dinate (x, y). 

stroke on the scroll appointment section 25. For exam- FIG. 14 is a block diagram showing data flow at the 
pie, as shown in FIG. 12, if points on the stroke given on 60 frame memory 22 and transformation controller 8. In 
the scroll appointment section 25 are detected with the the frame memory 22, the memory address control 
detection coil printed board 13 of the electromagnetic circuit 28 calculates upon request of the CPU 4 the 
coupling digitizer, the position displayed on the large memory address corresponding to the output coordi- 
screen is moved in the direction and by the distance nate for the liquid crystal panel 12, and writes in at the 
respectively corresponding to those of the stroke line 65 addressed portion the output coordinate data for the 
whose respective start and end points are adjacent the liquid crystal panel 12. Furthermore, the output coordi- 
two detected points. Since the timings of the digitizer nate data transferred from the transformation controller 
for detecting the signal are constant, if a stroke is drawn 8 via a memory address signal line 110 is transferred to 
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the transformation controller 8 through a frame mem- 
ory read-out signal line 109. 

In the transformation controller 8, a sequence control 
circuit 30 stores zooming display command and start 
address transferred from the CPU via the zooming and S 
start address signal line 113, and based on the stored 
information, controls associated circuits in the transfor- 
mation controller 8. The transformation controller 8 
reads out the output coordinate data from the frame 
memory 22 and converts it into a liquid crystal display 10 
signal which is transferred to the liquid crystal column 
drivers 21. In the present embodiment, the liquid crystal 
panel 12 uses 640 x 256 dots, and a register storing a 
start address is included in the sequence control circuit 
30. 15 

First, based on the start address stored in the se- 
quence control circuit 30, memory addresses for the 
frame memory 22 corresponding to the respective out- 
put coordinates of eight screens of the liquid crystal 
panel 12 divided at a memory address arithmetic calcu- 20 
lation circuit 31 are sequentially calculated, and the 
output data corresponding to the addresses in the frame 
memory 22 is requested. The output coordinate data are 
transferred via the data register 46 to respective ones of 
the eight registers of a parallel/serial (P/S) conversion 25 
circuit 34 corresponding to respective partial screens. 
The data is converted into a serial display signal which 
is transferred to the liquid crystal column driver 21. 

In the case of zooming display, based on the zooming 
command and start address stored in the sequence con- 30 
-trol circuit 30, memory addresses for the frame memory 
' 22 corresponding to the respective output coordinates 
of eight screens of the liquid crystal panel 12 divided at 
the memory address arithmetic calculation circuit 31 
are sequentially calculated, and the output data corre- 35 
sponding to the addresses in the frame memory 22 are 
requested. Since in the present embodiment only the § 
zooming display is available, the amount of output coor- 
dinate data four times as large as that in the equal magni- 
fication is required. The output coordinate data is trans- 40 
f erred via a data register 46 to a zooming circuit 47, 
"wherein data is converted into one-point data obtained 
through a logical product of four point data disposed 
transversely and laterally adjacent to each other. The 
one-point data is transferred to the parallel/serial con- 45 
version circuit 34 similarly to the above. 

Clock signals for the timings and for the liquid crystal 
drivers 20 and liquid crystal column drivers 21 are gen- 
erated at a timing generator circuit 48 based on a main 
clock signal transferred from the CPU 4 via a main 50 
clock signal line 114. 

With the above embodiment, (i) in the inputting of an 
input coordinate the zooming command and start ad- 
dress information signals are respectively stored as the 
variables of the equation (4) through the CPU 4. It is 55 
possible to readily effect coordinate transformation for 
zooming display and scroll appointment by using the 
equation (4). Furthermore, even if the line densities 
between that of the detection coil printed board 13 of 
the electromagnetic coupling type digitizer and that of 60 
the liquid crystal panel 2 do not coincide with each 
other, the coincidence of input and output points can be 
attained, (ii) At the output section, the liquid crystal 
controller 7 stores the start address and zooming display 
command and based on the stored information, the 65 
address, calculates for the display. The position under 
processing can be properly indicated since the zooming 
command and start address at the input and output 
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sections are simultaneously rewritten, (iii) If the scroll 
appointment section 25 is mounted on the crystal dis- 
play panel 12 so as to provide an exclusive area for the 
former, the mode changeover is not necessary for the 
scroll appointment and coordinate input (iv) By em- 
ploying an electromagnetic coupling type digitizer for 
requesting a scroll operation, the scroll operation can be 
initiated through a stroke drawn on the digitizer. Also, 
the scroll operation in any desired direction and at any 
desired speed can be achieved. 

(5) Third Embodiment of the Invention 

The description for the third embodiment of the pres- 
ent invention is directed to the case where the input 
integrated flat panel display is used as a peripheral de- 
vice of a personal computer, for example. Elements 
designated by identical numerals as used in description 
of the first and second embodiments perform the same 
corresponding functions. 

Although a frame memory for the liquid crystal dis- 
play is additionally provided in the present embodi- 
ment, this has been adopted in view of the differences in 
the refresh systems of the CRT display and liquid crys- 
tal display. 

The overall brief description of the present embodi- 
ment will be given in the following. 

The present embodiment can provide an input inte- 
grated flat panel display which is easy to be connected 
and versatile in use by using conventional signal lines 
provided at the personal computer main frame. 

In order to connect the input integrated flat panel 
display to a computer (processing machine) main frame, 
such as a personal computer, a video signal line for 
CRT screen display is utilized, which line is connected 
to the computer as an interface. In this case, since the 
display resolution of the CRT is different from that of 
the display section of the input integrated flat panel 
display, the whole screen of the CRT can not be dis- 
played within the input integrated flat panel display. 
Therefore, by storing information on which part of the 
video signals on the CRT screen to be displayed and 
based on the stored information, the input coordinate 
from the digitizer as the input means of the input inte- 
grated flat panel display is transformed into the coordi- 
nate information for the display screen so as to be trans- 
ferred to the computer main frame. Further, based on 
the stored information as to which part of the video 
signals on the CRT screen are to be displayed, the dis- 
play is carried out by partially picking up the display 
screen information to be displayed on the display from 
the video signals from the personal computer main 
frame, thus attaining coincidence between the input and 
display screen coordinates. 

The embodiment will now be described with refer- 
ence to the accompanying drawings. 

FIG. 15 shows an outer appearance illustrating a 
general system arrangement for inputting handwriting 
characters and graphics by using a personal computer. 
A CRT display 9' with a display resolution of 640X400 
dots and the digitizer 3 with the coordinate input pen 1 
are connected to the personal computer main frame 4 
respectively through a video signal line 120 and an 
expansion interface signal line 121 (for example, RS 232 
C signal line). Numeral 55 represents a keyboard, and 
numeral 121 represents a keyboard signal line. 

In contrast, FIG. 16 shows the outer appearance of 
the present embodiment, in which the connection of the 
input integrated flat panel display 5 to the personal 
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computer main frame 4 is arranged by using the expan- 
sion interface signal line 121 as an input from the digi- 
tizer and using the video signal line 120 itself as an 
output. In the present embodiment, the input integrated 
flat panel display is constructed as a unitary one by 5 
laying the 640x20O-dot liquid crysal panel 12 upon the 
detection coil printed board 13 of the electromagnetic 
coupling type digitizer. On the surface of the input 
integrated flat panel display, there are mounted a hand* 
writing section 12, scroll appointment section 25, and 10 
color appointment section 56, all outputs of which are 
detected on the detection coil printed board 13 of the 
digitizer. The handwriting section 12 also operates as 
the liquid crystal display screen, while the scroll ap- 
pointment section 25 is provided so as to properly per- 15 
form a scroll function in view of the fact that the display 
area of the display section (liquid crystal panel 12) of the 
input integrated flat panel display is smaller than the 
CRT display 9'. The color appointment section 56 in- 
cluding three areas R, G, and B corresponding to re- 20 
spective chrominance components, is provided for 
avoiding the. loss of color information. 

The operation of the input integrated flat panel 5 will 
be described with reference to FIG. 17, 

The input coordinate pointed out with the coordinate 25 
input pen 1 through the detection coil printed board 13 
of the digitizer is transferred to the digitizer controller 
15 via a digitizer detection coordinate signal line 101' 
and hence to the control unit 6 via an input coordinate 
signal line 101. The input coordinate information deliv- 30 
ered to the control unit 6 is transformed into coordinate 
information of the display screen (CRT). In this case, 
only the start address (scroll appointment) and color 
information are transferred via the start address signal 
line 102 and a color selection signal line 122 to the liquid 35 
crystal controller 8 serving as the display control sec- 
tion which controls the display on the liquid crystal 
display. The input coordinate information transformed 
into other coordinate information for the display screen 
is transferred via the expansion interface signal line 121 40 
to a video memory (not shown) of the personal com- 
puter main frame 4, In the present embodiment, the 
video memory for storing the information for the large 
screen is included in the personal computer main frame. 
The reason to transfer the start address (scroll appoint- 45 
ment) to the transformation controller 8 is to move the 
portion fetched from the video signals by acting upon 
the scroll appointment section 25. The reason to trans- 
fer the color information to the transformation control- 
ler 8 is that the loss of the color information can be 50 
avoided while the CRT video signal with color infor- 
mation is used for the monochrome input integrated flat 
panel display. 

The transformation controller 8 reads out the display 
screen information stored in the video memory of the 55 
personal computer main frame 4 through a video signal 
line 120. The transformation controller 8 picks up nec- 
essary portions from the stored information and re- 
quests a write-in to the liquid crystal frame memory 22 
via a liquid crystal frame memory write-in command 60 
line 123, and writes the display screen information into 
the liquid crystal frame memory using a liquid crystal 
frame memory write-in address signal line 110 and a 
liquid crystal frame memory write-in data signal line 
124. In other words, the transformation controller 8 65 
temporarily stores the start address and color informa- 
tion transferred from the control unit 6 and selects nec- 
essary display screen information in accordance with 
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the temporarily stored information so as to write it in 
the liquid crystal frame memory 22. Furthermore, the 
transformation controller 8 delivers a read-out address 
onto a liquid crystal frame memory read-out address 
signal line 125 in order to read out the display screen 
information written in the liquid crystal frame memory 
22, and reads out as output data the information in a 
parallel form from the liquid crystal frame memory 22 
via a liquid crystal frame memory read-out data signal 
line 109. Thereafter, the read-out data is converted into 
a parallel to serial form at the transformation controller 
8 to thereby deliver it to the liquid crystal driver 14 via 
a serial output data signal line 111, The liquid crystal 
driver 14 causes the liquid crystal panel 12 to display the 
coordinate of the display screen via the liquid crystal 
display signal line 16 (flexible printed wiring board). 

Next, the operation of the control unit 6 will be de- 
scribed with reference to FIG. 18. 

First, the input position of the coordinate input pen 1 
is checked from the detection coil printed board of the 
digitizer as to which section among the handwriting 
input section 12, scroll appointment section 25, and 
color appointment section 56 includes the input posi- 
tion. Thereafter, particular processings for each section 
are performed 

First of all, if the input coordinate transferred from 
the digitizer controller 15 is within the handwriting 
section 12, then the pointed position (X, Y) is trans- 
formed into the corresponding display screen coordi- 
nate (x, y) of the CRT as a large screen. The display 
screen coordinate (x, y) is transferred to write it in the 
video memory of the personal computer main frame 4. 
The equation for transforming the input coordinate (X, 
Y) into the display screen coordinate (x, y) is as follows, 



where a, b, c, and d represent predetermined constants 
for use in transforming the digitizer coordinate system 
into the liquid crystal coordinate system (0, Yo) repre- 
sents an address, which is called a start address, for the 
video memory of the personal computer main frame 
corresponding to the upper left coordinate in the liquid 
crystal display screen. The start address (0, To) as de- 
scribed later is a variable given in accordance with the 
scroll appointment, and it becomes (0, 0) if the scroll 
appointment is given. The input coordinate (X, Y) of 
the detection printed board 13 of the digitizer is thus 
transformed into a display screen coordinate (x, y) of 
the CRT beforehand, and the transformed coordinate is 
transferred to the video memory of the personal com- 
puter main frame 4. 

Secondly, if the input coordinate transferred from the 
digitizer controller 15 is within the scroll appointment 
section 25, then the start address (0, Yo) is calculated. 
The way to appoint a scroll and to calculate the start 
address are described in detail with reference to FIGS. 
19(c) and 19(A). 

The scroll appointment is carried out by drawing a 
stroke with the coordinate input pen 1 on the scroll 
appointment section 13 to designate the distance and 
speed of the scroll. FIGS. 19(a) and 19(b) are views 
illustrating points on strokes drawn on the scroll ap- 
pointment section 25 with the coordinate input pen 1. 
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Signals from the drawn stroke are detected by the de- where the address of the video data is counted. The 

tection coU printed board 13 of the digitizer at a certain start address transferred from the control unit 6 via the 

constant timing. The first detected point is regarded as start address signal line 102 is temporarily stored in a 

a starting point (X* Y,) and the second point is regarded start address storing register 32, the start address being 

as an end point (X* Y«) detected after a certain timing. 5 compared with the address for the video data at the 

The length of the line defined by the storting and end judgement and liquid crystal frame memory input ad- 

pomts corresponds to the movement of the displayed ^ acetic operation circuit 50. Among the video 

£ ree °- T*?*f °*l T T n ^wu 0 b / u • hC data > that data corresponding to 200 lines starting from 

nSt£^ 10 felmecomcid^ 

The start address calcSa^on Jf described in 10 * ™£ ^ S ^ frame t memory 22 ™ 

connection with the following equation and FIG. 19; 0 ^Ti T^Z *T c ° mmand 

0 n 1 signal line 123. The detailed operation of the judgement 

Yq dummy** YqHYs- y<) <«) ^ liquid crystal frame memory input address arithme- 
tic operation circuit 50 will be given later with refer- 
where Yo z)wwf ^represents a dummy start address, and 15 ence to FIG, 21. The video data R, G, and B associated 
Yo represents a start address at the preceding time. with color information are transferred to the color se- 
Upon calculation of the start address Yo dummy, the lection circuit 52, while the color information appointed 
validity of Yo dummy is checked. If the dummy start at the color appointment section 56 is transferred to the 
address is within the assigned area in the video memory same color selection circuit 52 via the color selection 
of the personal computer main frame 4; i.e., 20 signal line 122. In the color selection circuit 52, the 

serial data transformed into parallel data of one word 

0<Y 0 dummy<2€0 cight Wts is transferred to the liquid crystal frame mem- 

#u v v . « j- /nvv- ory 22 via the liquid crystal frame memory write-in data 

then Yo=Yo dummy, and the start address (0, Y 0 ) is signal line m ^ detailed opera tion of this circuit 

tra^ferredto^ 25 wiU be given with reference to FIG. 22. The liquid 

which part of the video signals is to be written into the ^ ^ m read . out address arithmetic « 

rZ^KSi nl? Tt ?nf^n ?? r ation 53 ** of the liquid ciys- 

from the surtmg point to the end point, oonsecutive ^ frame 2 f ^ ^ * 

pairs of starting and end pomts are generated, thereby „ n ,^ nl 7 , „ A , u« H ia ycu u« uic 

the screen moves in correspondence with its locus. In 30 1^ crystal panel 12 and requests a read-out yia a 

^this case, the timings at which the detection coil printed ^rystal frame memory read-out address signal line 

■board 13 of the digitizer detects signals are constant. J* 5 ' ™ e data ! s transfer y ed ™ the liquid crys- 

:. Therefore, if the stroke is rapidly drawn on the scroll memory read ;°* data lme 109 t0 th * p /$ 

appointment section 25, then the number of points de- conversion circuit 34 to convert it into a serial liquid 

tected per one stroke becomes smaller (FIG. 19(a)) and 35 crvstal s, S nal wmch ls transferred to the liquid crystal 

hence (Y.-Y,) becomes larger resulting in a large dn ^ 1 V la the J erial °. ut P ut data "B"? 1 line 111 

movement of the display screen. Alternatively, if the FIG> 21 ls a block of the judgement and 

stroke is slowly drawn, then the number of points per Uc l uid crvsta * frame memory write-in address arithmetic 

-one stroke becomes larger (FIG. 19(*))and hence |Y* operation circuit 50. Among the video signals trans- 

r~Y e \ becomes smaller resulting in a small movement of 40 ferred from the personal computer main frame 4, the 

::the screen. synchronous signals YLsync and Vsync are inputted to an 

If a newly calculated dummy start address is beyond X-direction scanning the detection circuit 501. Since 

the dimension of the video memory of the personal ^ch dot of the video data signal is latched, the detec- 

computer main frame, Le., if & on circuit 501 makes its output a logical "High" during 

45 the actual X-direction scanning time H^ 0 based upon a 

Yqdummy<Q video latch signal (CLK) delivered from the personal 

computer main frame 4. H sync and Vjj, nc are also inputted 

Yo dummy>IQ0 to a y^gQ s i gna i y-direction counter 502. The counter 

« 502 counts up upon H sync and clears upon V S ync for 

' 50 counting the address of the video memory for the video 

YYn=v rt n „ MUV „_o data. While the output from the X-direction scanning 

0 o dummy yo-v time detection circuit 501 is a logical "High", an X- 

yYo=Yq dummy— wo Yo=200 direction word counter 503 counts (3 bit counter) one 

word data (8 bits) and inputs an output carry to an 
are set and hence (0, Yo) is transferred to the controller 55 X-direction address counter 504 which in turn counts 
8 while (0, YYo) is transferred to the personal computer the address of the X-direction. A start address judge- 
main frame 4 via the expansion interface signal line 121 ment circuit 505 compares the video data address out- 
to request the rewrite of the video memory. put from the video signal Y-direction counter 502 with 
Further, if the input coordinate transferred from the the start address output from the start address storing 
digitizer controller 15 is within the color appointment 60 register 32. If both are equal, the judgement circuit 505 
section 56, then the appointed color information is makes the output "High". A Y-direction scanning time 
transferred to the controller 8 to request the screen detection circuit 50<S receiving the "High" output is a 
display of its color. J/K flip-flop which makes its output "High" while the 
FIG. 20 is a block diagram of the controller 8. Video liquid crystal panel 12 is scanned for the number of lines 
signals R, G f B, Hsy nc , and V,^ from the personal com- 65 (200 lines) in the Y-direction. The signal input to the K 
puter main frame 4 via the video signal line 120 are terminal of the circuit 506 is a carry output generated by 
transferred to a judgement and liquid crystal frame a Y-direction address counter 507 which counts the line 
memory input address arithmetic operation circuit 50 number of the Y-direction. At the same time, the Y- 
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direction address counter 507 counts the Y-direction are used. In this case, the video signal line from the 

address for the liquid crystal frame memory 22. In par- personal computer main frame is connected not only to 

ticular, while the logical product of the output from the the liquid crystal display section of the input integrated 

X-direction scaiining time detection circuit 501 and the flat panel display but also to the CRT display so that 

output from the Y-direction scanning time detection 5 both input integrated flat panel display and CRT dis- 

circuit 506 is "High", the liquid crystal frame memory p i av can be displayed. 
23 is requested for writing the data via the liquid crystal 

frame memory write-in command signal line 123. The 09 Other Modifications of the Invention 

Jesses counted by the Y^kcxtion address counter in the first, second, and third embodiments, the de- 

™T d ^ GWu t f?™™™**™™}^™* 10 scriptionhasbeendirectedtosystemarrangementssuch 

vmthc ihquid crystal frame memory write-in address &s the case where both inputs integrated flat panel dis- 

81 HG. 22 is a block diagram of the color selection j^^^ 
circuit 52. The video data R, G, and B among the video T JS^^^ 
signals delivered from the personal computer main 15 J£f*f™^ 

£ are transferred to the color selection circuit 52. ^ fla ' P^J^y system according to the pres- 
The color information r, g, and b from the control unit en ^ ^ m fo l lowmg - M u 

6 are transferred via the color selection signal line 122 to . (1 > A % RT «*» « m o™*d on the 

a color information register 511 where the information ^P^t surface of the input integrated flat panel display, 
is temporarily stored. Then, rR+g-G+b-B is inputted 20 . 23 shows the outer appearance of the input 

to the serial input terminal of a shift register 512, For flat panel display. The input integrated flat 

example, if the red portion of the color appointment panel display 5 is provided on its surface with the CRT 
section 56 is appointed, then coordinate input area 57 as well as the liquid crystal 

display section 12 (liquid crystal panel) serving as a 
r=0, g=l, b=l 25 hand-writing input section, scroll appointment section 

25, zooming display section 26 (not shown) and so on. 

are transferred from the control unit 6 and becomes Numeral 1 represents the coordinate input pen, and 

numeral 3 represents the electromagnetic coupling type 
r-R + g-G+ S-B - R digitizer. 

_ . , . . . , , ™ provision of such a CRT coordinate input area 

Therefore, only R of the video data is inputted to the 30 57 is to aim at improving the man-machine performance 

serial mput tcnnmal of the shift regater 512. The shift whfle the m t flat panel display is used in 

register 512 provides a one word (8 bits) parallel output common ^ the CRT di j In n ^ the CRT 

which is transferred via ^^cc^^ w^ coordinate input area is used for performing a rough 

2S£ 22* ^ 35 ^oke input and point input. In performing rough input 

According to the present embodiment as described ^^^JS? ^ » ".^ 

above, information (start address) on which part of the b "^l °* °" * e CRT coord !f ate f m *f 

large a^iaymforrna^ •*» w ^ e CRT screen, similar to the 

stored. Based upon the stored information, the input dl ^ r T m f ***** & stem composed 

coordinate is transformed into the coordinate infonna- 40 of a digitizer and CRT display), 

tion of the display screen to thereby transfer it to the ^ Scribed wiUi reference to the aforementioned 

personal computer main frame. Only necessary infor- embodiments, the Liquid crystal display area 12 com- 

mation is picked up from the large display screen infor- bm< ? m P ut out P ut > a ^ l™" «nput or 

mation (video signal) using the start address. Therefore, "P* ™ n * e perfumed on the hquid crystal 

even if the CRT video signal line is used as an interface, 45 display area 12. The scroll appointment area 25 is an 

the coincidence between the input coordinate and the Mea for ^nicting to display any desired partial image 

display screen coordinate can be attained. of ^ CRT screen > ^ scroll appointment area 25 mak- 

Furthermore, since the scroll appointment section 25 m S the P** 1 * 1 of the CRT supplied with a series 

is provided in order to enable the alteration of a start of fme m P uts which m out P ut onto the lic l uid cr ystal 

address, the movement of the display screen can be 50 display area 12 by acting upon the scroll appointment 

readily performed with the coordinate input pen 1. In m 25. 

addition, the rewriting of the video memory of the Although three areas have been set due to both uses 
personal computer main frame can be appointed in the °f tne m P ut integrated flat panel display and CRT dis- 
similar manner. pky» tnrce keys may be provided instead. This is a 

Still further, since the color appointment section 56 is 55 method to distinguish between three cases by appoint- 

provided, the loss of color information appointed with ing one of the keys, 

the coordinate input pen 1 can be avoided. (2) Improvements on Cursor Display. 

In the present embodiment, the CRT display resolu- In the input integrated flat panel display having the 

tion has been set as 640X 400 dots. However, also in the liquid crystal area, scroll appointment area, and CRT 

case of 1280X1024 dots, by using (X^, Y$) as a start 60 coordinate input area described in the above section (1), 

address, a partial image of the CRT screen displayed on the liquid crystal display area is used as an input area for 

the input section 12 of the flat panel display can be inputting a fine point input. Therefore, it can be thought 

scrolled up and down and right and left. Thus, the in- of as a cursor display. However, the cursor will flicker 

vention is applicable regardless of the display resolution so that the user on the contrary thinks it annoying, 

of the CRT screen. 65 Therefore, if the cursor display is given on a distin- 

In the present embodiment, it is apparent that the guished area only when a rough stroke or point input is 

man-machine performance is improved if both input carried out on the CRT coordinate input area, a more 

integrated flat panel display system and CRT display serviceable system for the user can be realized. 
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(3) Other Structure Of the Input Integrated Flat 
Panel Display. 

The input integrated flat panel display of the present 
invention has been described as having an arrangement 
including the upper liquid crystal panel and lower elec- S 
tromagnetic coupling type digitizer. However, it is 
possible to use as a display device a flat panel display 
such as EL, or plasma display device and to mount upon 
such display device a transparent digitizer such as of a 
pressure-sensitive type or elastic wave type. 10 

(7) Advantageous Effects of the Invention 

According to the present invention, disadvantages 
caused by the small dimension of the display screen are 
eliminated as compared with the conventional input 15 
integrated flat panel display. 

Furthermore, by using as an input device an input 
integrated flat panel dispay and using as an output de- 
vice a highly precise and fine CRT display, the man- 
machine performance improves extraordinarily. There- 20 
fore, in the case where the amateur end user performs a 
document processing, graphic processing or the like at 
the office, the input integrated flat panel system accord- 
ing to the present invention can be considered as one of 
ADSs (Advanced Office work-Station). 25 

We claim: 

1. An input integrated flat panel display system com- 
prising: 

an input integrated flat panel display device having 
an integrated structure, including input means for 30 
inputting handwritten data in the form of charac- 
ters, graphics, and points and a flat display panel 
integrally combined with said input means for dis- 
playing, display point data corresponding to hand- 
written data input through said input means; 35 

processing means for recognizing whether the dis- 
play point data relates to characters or graphics 
and for providing the display point data to the flat 
display panel for display; 
- large screen frame memory means coupled between 40 
said display device and said processing means for 
storing display point data for display on a large 
screen having a larger display area than that of said 
flat display panel; 

register means responsive to said input means for 45 
storing a start address indicative of a portion of said 
display point data for the large screen which is to 
be displayed on said flat panel display; 

transformation control means connected to said regis- 
ter means for transforming said input handwritten 50 
data into display point data for display on a large 
screen and for transferring said display point data 
to said processing device based upon the start ad- 
dress from said register means; and 

display control means responsive to said start address 55 
from said register means, for extracting a portion of 
said display point data from said large screen frame 
memory means for display on said flat display panel 
and for transforming said portion of data into dis- 
play point data for said flat display panel. 60 

2. An input integrated flat panel display system ac- 
cording to claim 1, wherein said input means comprises 
an electromagnetic coupling type digitizer and a liquid 
crystal display device forming said flat display panel is 
disposed upon said digitizer. 65 

3. An input integrated flat panel display system ac- 
cording to claim 1, wherein said input means includes a 
scroll appointment section including means for input- 
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ting said start address by means of a hand-held coordi- 
nate input pen, said scroll appointment section being 
integrated with said flat display panel, and further in- 
cluding means for changing the transfer of said input 
handwritten data to said transformation control means 
and the extracting of the display point data for said 
large screen at said display control means by changing 
the start address in said register means. 

4. An input integrated flat panel display system ac- 
cording to claim 3, wherein the start address for the 
point data for said large screen is changed by said 
changing means in accordance with the direction, dis- 
tance, and speed of a stroke by said coordinate input pen 
for changing the start address on said scroll appoint- 
ment section. 

5. An input integrated flat panel display system ac- 
cording to claim 1, wherein said input means includes a 
zooming display section including means for appointing 
a zooming display, said zooming display section being 
integrated with said flat display panel, said transforma- 
tion control means including means responsive to said 
zooming display section for changing the magnification 
of transformation of said input handwritten data into 
said display point data for said large screen, and said 
display control means includes means for extracting a 
portion of said display point data for said large screen, 
said extracted portion being proportional to a reciprocal 
of said magnification of transformation, and for display- 
ing said extracted portion on said flat display panel. 

6. An input integrated flat panel display system com- 
prising: 

an input integrated flat panel display having an inte- 
grated structure, including input means for input- 
ting handwritten data in the form of characters, 
graphics, and points, and a flat display panel laid 
upon said input means for displaying information 
corresponding to input point data input through 
said input means; 

processing means for distinguishing whether said 
input point data relates to characters or graphics 
and for providing display point data to the flat 
display panel; 

large screen frame memory means coupled between 
said flat panel display and said processing means 
for storing display point data for a large screen 
having a larger display area than that of said flat 
display panel; 

flat panel display frame memory means for storing 
display point data for display on said flat panel 
display; 

register means responsive to said input means for 
storing a start address indicative of a portion of said 
display point data for the large screen which is to 
be displayed on said flat display panel; 

transformation control means for transforming said 
input handwritten data into display point data for 
said large screen and for transferring said display 
point data to said processing device based upon the 
start address stored in said register means; and 

display control means responsive to the start address 
from said register means, for extracting a portion of 
said display point data for said large screen from 
said large screen frame memory means and for 
transforming said extracted portion into display 
point data for display on said flat display panel. 

7. An input integrated flat panel display system ac- 
cording to claim 6, wherein scroll appointment means 
for changing said start address is integrated with said 
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flat display panel, and includes means for changing the 
transfer of said input handwritten data to said control 
means and the extracting of the display point data for 
said large screen at said display control means by 
changing the start address for the point data for said 5 
large screen, 

8. An input integrated flat panel display system ac- 
cording to claim <5, further comprising color appoint- 
ment means integrated with said flat panel display for 
appointing color information, said transformation con- 10 
trol means and said display control means being con- 
trolled by said color information so that the appointed 
color is displayed on said flat display panel 

9. An input integrated flat panel display system com- 
prising: 

(a) an input integrated flat panel display structure 
including input means for inputting handwritten 
data in the form of characters, figures and points 
and a flat panel display integrated with said input 20 
means for displaying an image corresponding to 
said input handwritten data from said input means; 

(b) processor means coupled to said input means for 
discriminating whether said input handwritten data 

is a character or a figure and for providing display 25 
point data for display by said flat panel display; 

(c) control means coupled between said input means 
and said processor means for transforming input 
data from said input means into display point data 
for a large display screen, based on the start address 30 
held in said start address providing means, and for 
transferring said transformed display point data to 
said processor means; 

(d) frame memory means coupled to said processor 
means for storing display point data received from 35 
said processor means, said frame memory means, 
having a capacity for storing display point data for' 

a large display screen having a larger display area 
than that of the flat panel display; 

(e) start address providing means responsive to said 
. input means for holding a start address designating 

which portion of said display point data stored in 
said frame memory means is to be displayed on said 
flat panel display; and 45 

(f) display control means, connected between said 
frame memory means and said flat panel display 
and responsive to the start address from said start 
address providing means, for extracting from said 
frame memory means a portion of said display 50 
point data for said large screen and for transform- 
ing the extracted portion into display point data for 
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said flat panel display screen to display the trans- 
formed data thereon. 

10. The system according to claim 9, further compris- 
ing means including a cathode ray tube connected to 
receive display point data from said frame memory 
means for displaying said data thereon in parallel to the 
display of transformed data by said flat panel display. 

11. The system according to claim 9, further compris- 
ing second frame memory means connected to said 
processor means for receiving display point data from 
said processor means and for storing said display point 
data in parallel with the storing of said display point 
data in said first-mentioned frame memory means, and 
means including a cathode ray tube connected to said 
second frame memory means for displaying said display 
point data. 

1Z For use in a display system having a processor 
providing display point data, a frame memory for stor- 
ing display point data, and a display device having a 
large image screen for displaying display point data, a 
display data processing system comprising; 

(a) an input integrated flat panel display structure 
including input means for inputting handwritten 
data in the form of characters, figures and points, 
and flat panel display which is smaller than said 
large image screen and is integrated with said input 
means for displaying an image corresponding to 
said handwritten input data as a partial image of an 
image displayed on the large image screen; 

(b) register means responsive to a position designation 
signal from said input means for holding a start 
address designating which portion of display point 
data for the large image screen is to be displayed on 
said flat panel display; 

(c) first display point data transformation means re- 
sponsive to said input means for transforming 
handwritten input data into display point data for 
the large image screen, based on the start address 
held in said register means; and 

(d) second display point data transformation means 
responsive to the start address held in said register 
means for extracting a portion of said display point 
data for the large image screen and for transform- 
ing the extracted portion into display point data for 
the flat panel display, to thereby provide data for 
display of a partial image formed by the trans- 
formed data on the flat panel display, simulta- 
neously with display of an entire image formed by 
the display point data from said first display point 
data transformation means on the display device 
having the large screen. 

* # * * # 
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